Multi-Value-Functions: E cient Automatic Action Hierarchies for Multiple Goal MDPs

Multi - Value - Functions : E cient Automatic ActionHierarchies for Multiple Goal MDPs ( Draft of Nov 29 )

Multi - Value - Functions : E cient Automatic Action Hierarchies forMultiple Goal

If you have planned to achieve one particular goal in a stochastic delayed rewards problem and then someone asks about a diierent goal what should you do? What if you need to be ready to quickly supply an answer for any possible goal? This paper shows that by using a new kind of automatically generated abstract action hierarchy that with N states, preparing for all of N possible goals can be mu...

Basis function construction for hierarchical reinforcement learning

Much past work on solving Markov decision processes (MDPs) using reinforcement learning (RL) has relied on combining parameter estimation methods with hand-designed function approximation architectures for representing value functions. Recently, there has been growing interest in a broader framework that combines representation discovery and control learning, where value functions are approxima...

Multi-Value-Functions: Efficient Automatic Action Hierarchies for Multiple Goal MDPs

If you have planned to achieve one particular goal in a stochastic delayed rewards problem and then someone asks about a different goal what should you do? What if you need to be ready to quickly supply an answer for any possible goal? This paper shows that by using a new kind of automata caily generated abstract action hierarchy that with N states, preparing for all of N possible goals can be ...

Multi-level Association Rule Mining: an Object-oriented Approach Based on Dynamic Hierarchies

Previous studies in data mining have yielded e cient algorithms for discovering association rules. But it is well-known problem that the two controlling measures of support and con dence, when used as the sole de nition of relevant association rules, are too inclusive | interesting rules are included with many uninteresting cases. A typical approach to this problem is to augment the thresholds ...